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1. INTRODUCTION 

Today, the development of information technology in data driven decission making is an important 
things in bussiness world. The idea of the data driven decission making is that every decision based on data 
must be generalized from an effective set of primary information. Decision making is not only related with 
data but also related to measure of performance efficiency. Performance efficiency measurement deals with 
data envelopment analysis (DEA). In classic concept, DEA is non-parametric technique first proposed by [1] 
called Charnes, Cooper and Rhodes (CCR) model. This model using linear programming technique that 
produce a single efficiency measurement. Base of DEA is a linear programming technique to evaluate the 
relative efficiency of multiinput and multi multioutput decision making unit (DMU) on the observed data [2] 
by comparing DMU one with others that the utilities is same resources to produce the same output [3]. 

The main goal of DEA is intended as a method for performance evaluation and benchmarking [4]. 
DEA techniques have been widely used by many researchers for various field, including: measurement of 
efficiency radiotherapy treatment [5]; hotel performance evaluation [6]; evaluation of efficiency of logistic 
sustainability performance [7]; evaluation of teaching performance in university [8]; and efficiency analysis 
in emergency departments [9], [10]. The efficiency evaluation process often involves a stochastic approach 
because of uncertainty inherent in the data in real life problems [11], [12], the sochastic DEA model using 
input and output data with stochastic variations, and discussed develop an algorithm to help organization for 
evaluating performance in stochastic problems. Khodabakhshi [13], describes the superefficiency problem 
based on the input relaxation model in the DEA stochastic model. The relaxation superefficiency input model 
was developed through stochastic DEA (SDEA), deterministic equivalence, and also nonlinear program 
derivatives. Khodabakhshi and Asgharian [14], describes an input relaxation model and a stochastic version 
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into DEA that uses more flexibility of change that using combination of inputs to find the maximum possible 
output. The optimization models, such as stochastic programming, chance constraint programming, and 
robust optimization (RO) have been proposed to support decision making in uncertainty problems [15]. 

Motivation this study is how to determinate of evaluation performance based on data with DEA 
framework with combine SDEA model and robust optimization model. The SDEA formulation methods in 
this studies proposed by [16]. Determination efficiency problems with DEA contains of large data is difficult. 
This related to the completion of liner programming with large data. Therefore, this level of difficulty 
increase with uncertainty input and output [17]. Hence, the authors proposed the methods robust stochastic 
data envelopment analysis as an approaches model to evalatuate performance efficiency in uncertainty 
problems. To emphasise performance of efficiencies the proposed model, a comparison with SDEA model is 
made. 

This study is organized into sections as: section 2 presents methods and materials, explains the 
based DEA method, stochastic DEA (SDEA), robust optimization, and develops formulation robust 
stochastic DEA (RSDEA) and a numerical example. Section 3 explains the result and discussion. Section 4 
refers to the conclusion about studies. 


2. METHOD AND MATERIALS 
This section will introduce the concept of the based DEA model as a base of the framework in this 
research and preparation structured to build SDEA and the new RSDEA method. 


2.1. Based method of DEA 
Suppose there are n DMUs, each of them have varying amounts of m different inputs to produce s 


different outputs denoted by xjj,...,%mj and yjj,..-, Ysj , as the respective input and output vectors of DMU}. 
This study using the based method of DEA provided by [1] as: 


maxi Mize, y Èr=1 UrYro (1) 


Subject to: 


2.2. SDEA 

The following development SDEA methods assume a stochastic framework with all input variables 
transformed to output variables. Let variable of DMU,(s = 1,2,3,...,r) which all of them have random 
behavior. Let us further assume that &, = (Ùir M2,,...,M,) for each @,;(r = 1,...,5) denoting output 
components has probability distribution. By maximizing the expected of efficiency evaluated DMU, as: 


MaxE (yü) (2) 
Subject to: 
prob(y‘tj < Bj) =1 


uzo 
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In (2) transformed into a deterministic DEA form by considered from stochastic DEA. In [18], 
model Chance constraint programming have new variables with standard normal distribution, as following 
model: 


y‘(aj-uj) 


g, = UE) j= 12,...,N (3) 


varj 


By substituted (2), (3) as: 


Bj-y*ūj 


prob | Zz < >1-a; (4) 


varj 


Furthermore, with simply converted into following form: 


Jayla, 
Pry Fi > (1-a), f =1,2,...,N (5) 


varj 


From (2), (5), simply transformation as following equivalent linear programming model as follows: 


Maximize y‘ ito (6) 
Subject to: 
Bi -yÑ 2 ytho (A - a), j = 1,2,...,N 0) 


2.3. Robust optimization 

Robust optimization model when decision makers have to choose a strategy without knowing the 
exact value taken from an uncertain parameter. Robust optimization become popular approach as a robust 
methodology for solving the model optimization in uncertainty problems by providing a feasible solution in 
it’s the objective function. This approach to optimized mathematical uncertainty and maintain tractability of 
the model as proposed by [19]. Robust Optimization Model has been used to make decisions in dynamic 
environments where future decisions depends on the realization of data such as inventory issues [20], 
contracts [21] and project expansion planning [22]. Uncertainty has two forms: (i) estimation for constant 
value parameter, (ii) stochastic random variables. Optimization developed based on 2 principles [23]-[25], a 
modern practice in operations uncertainty management: i) estimating with often fail point and must be 
replaced with range estimates; ii) estimating with aggregate are more accurate than individual estimates. To 
present the robust framework in mathematics way [26] consider following linier programming problem: 
Minimize c'x 
Subject to: Ax > b, 


xEX (8) 


One of based issues of (6), the uncertainty problem about feasebility. In particular, the decision 
maker will ensure that every constraint is included for the possible value of A within a certain specified 
uncertainty of A. The set A is assumed each aj; coefficient of matrix A is an uncertainty constraint, and all 
coefficients are independent. The decision maker knows the various estimates for all the uncertain 
parameters, in particular the parameter a,; belongs to a symmetrical interval [a; j— Gp Ay + âi jl centered on 
the approximate point a;; when measuring the accuracy of estimate. 


2.4. Developed RSDEA method 

In this study, the formulation of the proposed RSDEA aims to maximize the efficiency of the multi- 
uncertainty output of the stochastic DEA (SDEA) methods and its robust optimization. The formulation 
method is an equivalent deterministic model to be solved using linear programming. 

Let for each variable of DMU,(s =1,2,3,...,r) has random with expressed by 
ti, = (Čr, zr... sr), for each t,,(t = 1,2,3,...,5) also suppose all in variable are jointly probability 
distributed. The uncertainty of DEA for (%; j) input or (Ji i) output are data wich is developed by the error. 
By the maximize the objective of (6) , then the Robust DEA method be given as: 
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Maximize c x 


Subject to: 

n 
> cx <hi 

j=1 

m 
X BiF0 = 1 

i=1 

S m 

UV j -Y aR <0;j =1,...,n 

r=1 i=1 


ŭ, > 0;r = 1,...,S (8) 


Subtitute (8) with (2) as: 


S 


Maximize: y ü ,Y,o (9) 


r=l 


Subject to: X$- 9,9 < bi 


Since (9), at the first constraint F_,%,¥,9 < bi, reformulated to giving the score of super 
efficiency. In (9) will change with the constraint at (7) in order to the constraint not deviation on surplus 
variable M. Further at the constraint (7) there is an inequality greater than equal to, so the constraint (7) 
reformulated as: 


yt(bjp (1-a) +a) <6 fH..N (10) 


Let b; = 1 and all of input convert to be output with a = risk level and also p =aspiration level. 
Then the formulation (9) and (10) called RSDEA can be formulated as: 


Maximize X$- ú, Vo (11) 
Subject to : y'(bo-1(1 — aj) + ù) < Bf =1,...,N (12) 
Sm bomi (13) 
Era drj a Peay s0 Falah (14) 


(6;,%,) = 0i = 1,...,m; r = 1,...,S 


In other words, the formulation formed above produces a method formulation with the objective 
function of maximizing the expectation of DMU evaluation on the number of outputs by considering the 
following constraints: a. multiplying the cumulative distribution function of the output is less than or equal to 
the value of the aspiration level, b. the result of adding up all the inputs must be equal one, c. the result of the 
difference between the number of outputs and inputs must be less than zero. 
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2.4. Numerical example 

To understand the performance of the proposed RSDEA, we implement proposed (11) to (14) to 
analyze the efficiency performance of the college. For estimating the efficiency performance measure with 
this RSDEA, this study adopts 12 DMUs with four inputs and four outputs. In this case, given value of 
a = 0.2, B = 0.9 and #71 = 1.0625. Table 1 gives the information data of inputs and outputs. All of the 
data inputs are the mean of the number of lecturers, students, research of funding, employees. As well as the 
outputs data which is the mean of the number of alumni, research publications, and LPM. 


Table 1. Information data of DMUs with 4 inputs and outputs 


DMU I L b L4 O O O _ © 
DMU; 17 588 20 5 6l0 5 5 5 
DMU, 26 7⁄7 25 6 533 5 5 5 
DMU; 15 396 15 4 195 5 4 5 
DMU, 17 467 20 3 30 5 5 5 
DMU; 25 348 25 2 252 5 7 5 
DMUs 23 499 20 2 224 5 5 5 
DMU, 19 420 22 1 326 5 6 5 
DMUs 17 689 20 4 273 5 5 5 
DMU, 34 822 35 5 284 5 4 5 
DMU» 10 501 10 7 204 5 4 5 
DMU; 11 719 10 4 273 5 8 5 
DMU» 11 262 10 2 183 5 4 5 

3. RESULTS AND DISCUSSION 


This study aims to develop the new robust stochastic DEA (RSDEA) methods to tackle uncertainty 
problems (i.e., stochastic and robust optimization. The objective function of the RSDEA is to maximize the 
efficiency of multi-output from the uncertain stochastic model and robust optimization. In this case, input 
variable denotes v and output variable denotes u. The numerical example as performed the proposed methods 
to determine performance efficiency, we use the case study to maximize the output to get efficiency 
performance of the college. On the Table 1 show 12 DMUs with 4 inputs and 4 outputs. Furthermore, based 
on a case, we solved the formulation 12 times according to the number of DMUs, with each formulation 
having the same constraints. Developing this formula was extended from the formulation of the proposed 
method for DM U4 as according to this study case as: 


Maximize 610u, + 5u3 + 5u3 + 5u3 (15) 
Subject to: 
610.85u, + 5.85u, + 5.85u3 + 5.85u, + 17.85u5 + 588.85u, + 200.85u, +5.85ug < 0.9. (16) 
533.85u, + 5.85u, + 5.85u3 + 5.85u, + 26.85us5 + 747.85u6 + 250.85u7 +6.85ug < 0.9 (17) 
195.85u, + 5.85u, + 4.85u3 + 5.85u, + 15.85u5 + 396.85u, + 150.85u,+4.85ug < 0.9 (18) 
300.85u, + 5.85u, + 5.85u3 + 5.85u, + 17.85u; + 467.85u, + 200.85u, +3.85ug < 0.9 (19) 
252.85u, + 5.85u, + 7.85u3 + 5.85u, + 25.85u, + 348.85u, + 250.85u, + 2.85ug <0.9 (20) 
224.85u, + 5.85uz + 5.85u3 + 5.85u, + 23.85u, + 499.85u, + 200.85u, + 2.85ug < 0.9 (21) 
326.85u, + 5.85u, + 6.85u3 + 5.85u, + 19.85u, + 420.85u, + 220.85u71.85ug < 0.9 (22) 
273.85u, + 5.85uz + 5.85u3 + 5.85u, + 17.85u, + 689.85u, + 200.85u, + 4.85ug < 0.9 (23) 
284.85u, + 5.85uz + 4.85u3 + 5.85u, + 34.85u, + 822.85u, + 350.85u7 + 5.85ug < 0.9 (24) 
204.85u, + 5.85uz + 4.85u3 + 5.85u, + 10.85us5 + 501.85u, + 100.85u, + 7.85ug < 0.9 (25) 
273.85u, + 5.85uz + 8.85u3 + 5.85u, + 11.85u, + 719.85u6 + 100.85u, + 4.85ug < 0.9 (26) 
183.85u, + 5.85u, + 4.85u3 +5.85u, + 11.85u, + 262.85u, + 100.85u, + 2.85ug < 0.9 (27) 


17v, + 588v, + 200v; + 5v, = 1 (28) 
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610u, + 5u; + 5u; + 5u, — 17v, — 588v, — 200v; — 5v, < 0 (29) 
533u, + 5u, + 5u3 + 5u4 — 26v1 — 747v, — 250v; — 6v, < 0 (30) 
195u, + 5uz + 4u; + 5u, — 150v, — 396v, — 150v, — 4v, < 0 (31) 
300u, + 5uz + 5u3 + 5uy — 17v, — 467v, — 200v; — 3v, < 0 (32) 
252u, + 5u + 7u; + 5u, — 25v, — 348v, — 250v; — 2v, < 0 (33) 
224u, + 5u; + 5uz + 5u4 — 23v, — 499v, — 200v; — 2v, < 0 (34) 
326u, + 5u; + 6u; + 5u, — 19v, — 420v, — 220v; —v, < 0 (35) 
273u, + 5u2 + 5u3 + 5u, — 17v, — 689v, — 200v; — 4v, < 0 (36) 
284u, + 5u, + 4u3 + 5u, — 34v, — 822v, — 350v; — 5v, < 0 (37) 
204u, + 5u; + 4u; + 5u, — 10v, — 501v, — 100v; — 7v, < 0 (38) 
273u, + 5u, + 8u; + 5u, — 11v, — 719v, — 100v; — 4v, < 0 (39) 
183u, + 5u, + 4u; + 5u, — 11v; — 262v, — 100v; — 2v, < 0 (40) 


The formulation of the RSDEA can be solved using the LINDO software as shown Figure 1. The 
calculation is carried out 12 times, according to the number of DMUs to the case. Each DMU (this case the 
DMU is defined as major of department) has a different objective function with the same constraints. 


H LINDO - [Reports Window] 
N File Edit Solve Reports Window Help 


oleae] slaleloiale/=|a| Slo| elem Le) eel 


LP OPTIMUM FOUND AT STEP 2 


OBJECTIVE FUNCTION VALUE 


1) 0.8987476 
VARIABLE VALUE REDUCED COST 
Ul 0.001473 0.000000 
U2 0.000000 0.841860 
u3 0.000000 0.841860 
U4 0.000000 0.841860 
US 0.000000 17.825163 
U6 0.000000 588.030579 
u7 0.000000 200.570526 
ug 0.000000 5.841860 
V1 0.000000 0.000000 
V2 0.001701 0.000000 
v3 0.000000 0.000000 
va 0.000000 0.000000 
ROW SLACK OR SURPLUS DUAL PRICES 
0.000000 0.998608 


113448 
611443 
456741 
527462 
568716 
418433 
496521 
480314 
598183 
496521 
629123 
000000 
101252 
485109 
386165 
352211 
220551 
518608 
233971 
769542 
979526 
551476 
820563 
175954 


000000 
000000 
000000 
000000 
000000 
000000 
000000 
000000 
000000 
000000 
000000 
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000000 
000000 
000000 
000000 
000000 
000000 
000000 
000000 
000000 
000000 
000000 
000000 


O OA L N H O D 0 N 0 ON e t N H O D O N O A e U N 
ooooooooo0o0o0o000000000000 
oooooooo0o0o00000000000000 
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Figure 1. Efficiency value of DMU; using the LINDO software 


This study proposed a new method called RSDEA to evaluate the effectiveness of performance to 
tackle uncertainty problems with deals data-driven indeed input and output. Assess the efficiency of the 
proposed model; a confirmed case of the college with 12 departments of majors, 4 inputs, and 4 outputs was 
studied, as shown in Table 1. The data inputs are mean values of lecturers, students, research of funding, 
employees. As well as the outputs data which is the mean values of alumni, research publications, and LPM. 
In this case, given value of a = 0.2. Furthermore, the RSDEA develops by extended SDEA with the robust 
optimization method. In (15) is only to maximize the output without changing the inputs. For (16) until (27) 
are the constraints of the SDEA formula where all inputs change with outputs, then there are eight outputs. 
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(28) until (40) also the constraints from the DEA framework. The result of RSDEA shows in Table 2. The 


higher value of the optimal efficiency from Table 2 is 0,8987476 or represents 89% at DMU1. That means 
the optimal performance efficiency with the RSDEA method obtained 89% only at DMU1. 


Table 2. Result of the efficiency formulation RSDEA 


DMUs Result of RSDEA formulation 
DMU, 0.8987476 
DMU., 0.7379925 
DMU; 0.7274454 
DMU, 0.7136675 
DMU; 0.7692308 
DMUs, 0.7692308 
DMU; 0.7692308 
DMU; 0.6718858 
DMUs 0.4292363 
DMU o 0.7692308 
DMU;, 0.8316246 
DMU i. 0.7692308 


4. CONCLUSION 

We have presented perform the proposed RSDEA method to evaluate the efficiency with uncertainty 
multi-inputs and multi outputs. The development of RSDEA methods carries out using linear programming 
techniques. RSDEA methods have the optimal solution to evaluate the effectiveness of performance to tackle 
uncertainty problems. Recommendation for the implementation of further research considering extending this 
approach by examining the characteristics of data uncertainty at each input and output by providing the best 
scenario in constraints for maximizing or minimizing the objectives of the RSDEA. 
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